Audiovisual perception of counter-expectational questions
نویسندگان
چکیده
The precise nature of the interaction between acoustic and visual information in the perception of prosodic information is a question that still remains unclear. Though the fuzzy logical model of perception (FLMP) has been shown to explain the recognition of segmental information, this model also needs to be tested in the field of suprasegmentals such as facial gestures. The first goal of this paper is to investigate, by means of a computer-generated 3D video character, the interaction between intonational and gestural information in the detection by listeners of counter-expectational questions compared to narrow focus statements. The second goal is to test which specific facial gesture conveys the counter-expectation meaning most clearly. Our results represent a further step for considering an FLMP approach to the analysis of audiovisual prosody.
منابع مشابه
Transfer from action to perception: The effect of motor-perceptual enrichment
This study investigated the effect of audiovisual integration on action-perception transfer.40 subjects were randomly divided four groups: visual, visual-auditory, control visual and control visual-auditory. Visual groups watched pattern skilled basketball player and other groups in addition to watching pattern skilled basketball player, heard Elbow angular velocity as sonification. In first st...
متن کاملThe development of sensorimotor influences in the audiovisual speech domain: some critical questions
Speech researchers have long been interested in how auditory and visual speech signals are integrated, and the recent work has revived interest in the role of speech production with respect to this process. Here, we discuss these issues from a developmental perspective. Because speech perception abilities typically outstrip speech production abilities in infancy and childhood, it is unclear how...
متن کاملA Causal Inference Model Explains Perception of the McGurk Effect and Other Incongruent Audiovisual Speech
Audiovisual speech integration combines information from auditory speech (talker's voice) and visual speech (talker's mouth movements) to improve perceptual accuracy. However, if the auditory and visual speech emanate from different talkers, integration decreases accuracy. Therefore, a key step in audiovisual speech perception is deciding whether auditory and visual speech have the same source,...
متن کاملAudiovisual verbal transformations, as a way to study audiovisual interactions in speech perception
Verbal transformations refer to perceptual changes experienced while listening to a speech form cycled in rapid and continuous repetition. In order to test whether visual information from the speaker's articulatory gestures may modify the emergence and stability of verbal auditory percepts, participants were instructed to report any perceptual changes during unimodal, congruent audiovisual and ...
متن کاملThe Projection of Not-at-issue Meaning via Modal Support: The Meaning and Use of the Japanese Counter-Expectational Adverbs
This paper discusses the phenomenon of what I call the “projection of non-at issue meaning via modal support” shown in the Japanese counterexpectational intensifier yoppodo and the counter expectational scale-reversal adverb kaette, and considers the variation of projective content from a new perspective. I show that, unlike the typical conventional implicatures (CIs) like appositives and expre...
متن کامل